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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a method for generating poses and 
motions in a tree structure link system consisting of a plurality of links which 
are connected with joints created by modeling, etc., of humans, animals and 
robots, etc. 

SOLUTION: The poses and the motions in the tree structure system are 
generated according to constraining conditions by providing the constraining 
conditions to the optional number of optional links or permitting optional 
addition or release of the constraining conditions halfway of generation. 
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CLAIMS 



[Claim(s)] 

[Claim 1] In the approach of generating the pause of a tree structure link 
system and actuation which were made by modeling of human being, an 
animal, a robot, etc., which were connected at the joint and which consist of 
two or more links The approach characterized by generating the pause of said 
tree structure link system which follows these constraints by allowing giving 
the constraint of the number of arbitration to the link of the arbitration of the 
number of arbitration, or setting in the middle of generation, and adding or 
canceling a constraint to arbitration, and actuation. 
[Claim 2] How to generate the pause of a tree structure link system and 
actuation which are characterized by said constraint containing the location of 
said link and a posture, and the rate from which these change and angular 
velocity in the approach of generating the pause of a tree structure link 



system according to claim 1, and actuation. 

[Claim 3] How to generate the pause of a tree structure link system and 
actuation which are characterized by including making it said constraint not 
exceed said movement range where all or some joints were specified in the 
approach of generating the pause of a tree structure link system according to 
claim 1 or 2, and actuation. 

[Claim 4] How to generate the pause of a tree structure link system and 
actuation which are characterized by making it a spherical-surface joint not 
exceed the movement range using the approach said joint expresses the 
movement range intuitively including the spherical-surface joint of three 
degrees of freedom, in the approach of generating the pause of a tree 
structure link system according to claim 3, and actuation. 
[Claim 5] How to generate the pause of a tree structure link system and 
actuation which are characterized by including that said constraint becomes 
as close to the target joint value and target joint rate to which all, or some the 
function values and joint rates of a degree of freedom were given as possible 
in the approach of generating the pause of a tree structure link system 
according to claim 1, 2, 3, or 4, and actuation. 

[Claim 6] How to generate the pause of a tree structure link system and 
actuation which are characterized by realizing a constraint in the approach of 
generating the pause of a tree structure link system according to claim 1, 2, 3, 
4, or 5, and actuation by considering the stability according to an error with an 
ideal condition to each constraint. 

[Claim 7] How to generate the pause of a tree structure link system and 
actuation which are characterized by setting priority as said constraint in the 
approach of generating the pause of a tree structure link system according to 
claim 1,2,3, 4, 5, or 6, and actuation. 

[Claim 8] In the approach of generating the pause of a tree structure link 
system according to claim 7, and actuation In case the pause of said tree 
structure link system according to said constraint and actuation are generated, 
reverse kinematics count is used. How to generate the pause of a tree 
structure link system and actuation which are characterized by using a 
singular point low sensibility movement part solution method in order to permit 



the demand of strictness, and relaxation of strictness to the solution of said 
reverse kinematics count by the priority of said constraint and to solve the 
singular point problem of said solution. 

[Claim 9] How to generate the pause of a tree structure link system and 
actuation which are characterized by the ability to perform addition and 
discharge of said constraint to the link which exercises by actuation under 
movement in the approach of generating the pause of the tree structure link 
system of a publication, and actuation in claim 1 thru/or any 1 term of 8, when 
said tree structure link system has the existing movement data. 
[Claim 10] How to generate two or more key frames by the approach of 
generating the pause of the tree structure link system of a publication, and 
actuation in claim 1 thru/or any 1 term of 9, and generate a series of actuation 
of said tree structure link system by the interpolation operation between said 
key frames. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the approach of generating the 
pause of a tree structure link system and actuation which were made by 
modeling of human being, an animal, a robot, etc., which were connected at 
the joint and which consist of two or more links. 
[0002] 

[Description of the Prior Art] The data showing actuation of human being who 
appears in the animation of computer graphics, movie work, a game, etc., an 
animal, etc., The Prior art which generates the data showing actuation of a 
robot with many joints, such as a humanoid [1] Choi and KJ and Ko, H. S. : 
"Online Motion Retargetting and "the Journalof Visualization and Computer 
Animation and vol.11, -235, pp.223.[ 2000] [2] Gleicher, M.and Litwinowicz, 



P. : "Constraint-based Motion Adaptation" the Journal of Visualization and 
Computer Animation, vol.9, pp.65-94, 1998.[3] Lee, J.and Shin, S.Y. : "A 
Hierarchical Approach to InteractiveMotion Editing It is announced in papers, 
such as for Human-like Figures, "Proceedings of SIGGRAPH'99, pp.39-48, 
and 1999. Each of these is techniques which calculate movement with which 
are satisfied of a constraint without a guide peg slippery [ with optimization 
count ] to the ground for the purpose of applying the motion capture data 
obtained beforehand to the tree structure link system of various human molds 
with which link die length etc. differs, or making new movement, with the 
description of movement saved. 

[0003] Movement to which each joint angle becomes as close to the desired 
value given, respectively as possible is calculated fixing the location of an end 
link to the above-mentioned bibliography [1] with the technique of a 
publication. Movement which performs global optimization and fills a 
constraint with a technique given in reference [2] so that a constraint may 
become smooth over the whole movement is calculated. With the technique ■ 
given in reference [3], it makes it possible to change some bodily postures, 
with a constraint satisfied by expressing a constraint with a hierarchical spline 
function. Optimization count is carried out to the whole movement like the 
technique of reference [2]. 
[0004] 

[Problem(s) to be Solved by the Invention] Motion capture data etc. need to 
be reference exercised about the technique of the above-mentioned reference 
[1], [2], and [3]. The capture of the actuation new [ although the cost which 
motion capture takes compared with the former is also reduced and capture 
library of data are also marketed increasingly ] whenever the actuation which 
is not included to a library is needed must be carried out, the actuation made 
from the still more nearly same library tends to become a similar thing, and 
the fault that great time amount and efforts were needed for correcting 
actuation according to liking of one was. 

[0005] Since global optimization count was performed about the above- 
mentioned reference [2] and the technique of [3], there was a fault that it was 
the real time into which an input comes serially, or could not apply to 



interactive movement generation. 

[0006] When the constraint was added to links other than an end link about 
the technique of the above-mentioned reference [1], there was a fault that a 
count result might emit. Moreover, when it was going to fix much links, there 
was a fault that a solution might not be acquired. 

[0007] Although commercial computer graphics software was equipped with 
the interface for specify the location of the tip link of the link structure for 
animation work , since the pause of the whole tree structure link system was 
not able to be changed , there was a fault that natural pause creation was 
difficult at these , only by calculate the joint angle of the partial link train 
equivalent to one branch of a tree structure link system , such as an arm and 
a foot . 

[0008] As a link to fix, only the tip link of a link train has been specified 
conventionally. This is for conflict arising between each constraint, when there 
is only a small number of joint among two or more links fixed, and causing a 
breakdown to numerical calculation. 

[0009] The movable range of a spherical-surface joint was not taken into 
consideration by the Prior art. 

[0010] Even if this invention does not have the existing movement data, such 
as motion capture data For example, a human figure skating with many joints 
and many (20 or more [ for example, ]) degrees of freedom is received. In 
order to enable it to generate the exercise of the whole body in character with 
human being on real time by easy actuation of showing the orbit of one piece 
or two or more links Or when there are movement data, such as motion 
capture data, in order to enable those corrections and reuse by the above- 
mentioned actuation, it aims at offering the approach of generating the pause 
of the tree structure link system which conquered the fault of the above- 
mentioned Prior art, and actuation. 
[0011] 

[Means for Solving the Problem] The 1st invention according to claim 1 is 
characterized by generating the pause of said tree structure link system 
according to these constraints, and actuation by allowing giving the constraint 
of the number of arbitration to the link of the arbitration of the number of 



arbitration, or setting in the middle of generation, and adding or canceling a 
constraint to arbitration. 

[0012] The 2nd invention according to claim 2 is characterized by said 
constraint containing the location of said link and a posture, and the rate and 
angular velocity from which these change. 

[0013] The 3rd invention according to claim 3 is characterized by including 
making it said constraint not exceed the movement range where the joint was 
specified. 

[0014] The 4th invention according to claim 4 is characterized by making it a 
solid sphere joint not exceed the movement range using the approach said 
joint expresses the movement range intuitively including the spherical-surface 
joint of three degrees of freedom. 

[0015] The 5th invention according to claim 5 is characterized by including 
that said constraint becomes as close to the target joint value and target joint 
rate to which all, or some the function values and joint rates of a degree of 
freedom were given as possible. 

[0016] The 6th invention according to claim 6 is characterized by realizing a 
constraint by considering the stability according to an error with an ideal 
condition to each constraint. 

[0017] The 7th invention according to claim 7 is characterized by setting 
priority as said constraint. 

[0018] The 8th invention according to claim 8 is characterized by using a 
singular point low sensibility movement part solution method, in order to use 
reverse kinematics count, to permit the demand of strictness, and relaxation 
of strictness to the solution of said reverse kinematics count by the priority of 
said constraint and to solve the singular point problem of said solution, in case 
the pause of said tree structure link system according to said constraint and 
actuation are generated. 

[0019] The 9th invention according to claim 9 is characterized by the ability to 
perform addition and discharge of said constraint to the link which exercises 
by actuation under movement, when said tree structure link system has the 
existing movement data. 
[0020] 



[Effect of the Invention] Since it cannot be premised on movement data, such 
as motion-capture data, only count can generate movement, it can use also 
for processing of the existing movement data and optimization covering the 
whole movement does not perform according to above-mentioned this 
invention, movement can generate with reception for an input on real time, 
and movement which moves from a certain location to another location in a 
thing can realize easily by specifying the orbit of a link. 

[0021] According to the 2nd invention, generation of movements when contact 
etc. has received constraint from the environment becomes easy by setting up 
a fixed link. 

[0022] According to the 3rd invention and the 4th invention, it can prevent 
becoming the posture which has not been used as human being, the animal, 
the robot, etc. by setting up the joint movable range. Moreover, bodily 
hardness and softness can be adjusted. 

[0023] According to the 5th invention, movement to which a little a certain 
existing movement was changed, and generation of periodic motion become 
easy. 

[0024] According to the 6th invention, various constraint can be realized now 
only for local information, and generation of real time and interactive 
movement is attained. 

[0025] According to the 7th invention and the 8th invention, a constraint can 
set only the number of arbitration as the location of arbitration, and even when 
they are contradictory, it can calculate appropriate movement according to the 
priority set up beforehand. 

[0026] According to the 9th invention, when movement data already exist, it 
can carry out based on it and new movement can be made by the same 
actuation. 

[0027] As a field of the invention, generation of the animation of computer 
graphics, movie work, a game, and a humanoid of operation etc. can be 
considered. The use as plug-in of the count engine of the software which it 
used as independent software also in which field, and also added a certain 
graphical interface, and the existing computer graphics software is possible. 
[0028] It is important to become the same posture for every period in periodic 



motion, such as locomotion. This point is also realized by installation of a 
target joint value. If the movement orbit of the link which gave constraint by 
setting up a target joint value is periodic, movement of the whole body will 
also become periodic. 

[0029] A natural exercise of the whole body of tree structure link system 
models, such as human being and the animal which were obtained only when 
the animator of the pro who received training made, applying many time 
amount and efforts or carried out a capture from movement of actual human 
being or an animal using expensive equipments conventionally, and a robot, 
can be created now by actuation with easy anyone putting the above 
effectiveness together. Moreover, since movement generation on real time is 
possible, it can use as a count engine for the field of which high interactive 
nature, such as a game, is required to also generate various movements 
according to a situation. 

[0030] In the robotics field, there is effectiveness applicable as an intuitive 
interface for operating a robot with many joints, such as a humanoid. Since 
there are many variables which should be operated among such robots, only 
what was restricted until now [, such as showing the direction along which he 
walks as an interface for performing interactive actuation, ] is realized. By this 
invention, various movements can be directed now to a robot in a broad 
scene. 

[0031] Moreover, two or more key frames are generable by the approach of 
generating the pause of a tree structure link system and actuation by above- 
mentioned this invention. For this reason, this invention relates also to the 
approach of generating a series of actuation of said tree structure link system 
by the interpolation operation between said key frames, such as key frame 
animation. 
[0032] 

[Embodiment of the Invention] Drawing 1 is drawing showing an example of 
the model which can apply the approach of generating the pause of a tree 
structure link system and actuation by this invention. This human mold tree 
structure link system model is a person who appears for example, in a 
computer graphic, or is a model used for the intuitive interface for operating a 



robot with many joints, such as a humanoid. With this model, two or more 
links are connected at the spherical-surface joint of two or more three degrees 
of freedom, and the rotation joint of two or more one degrees of freedom. 
[0033] The system which performs the data generation method of operation 
by this invention can be mounted as the count engine called from the 
independent software or other software which are performed for example, on 
a computer, and plug-in. Drawing 2 is the flow chart of the data generation 
method of operation by this invention. Although the example of the interface 
for performing each I/O and actuation from the outside was also included in 
this drawing as reference, the range of this invention is the part surrounded by 
the thick wire. 

[0034] the system which performs the data generation method of operation by 
this invention - the general solution - it has - null space count section 3, the 
objective function rate count section 4, the optimization count section 5, and 
the integral section 6. 

[0035] The link which wants to specify an orbit by the click of the mouse which 
is an external interface etc. in the tree structure link system displayed on the 
display (not shown) (14 15), and a link to fix all over space are chosen, and 
the orbital appointed link select data 1 1 and the fixed link select data 12 are 
inputted. These links can also be changed during real-time generation of 
subsequent data, the orbital appointed link select data 11- the general 
solution — it inputs into - null space count section 3. next, a motion (1) of the 
mouse and joy stick which are an external interface about the orbital data (2) 
of the link chosen as a link which wants to specify an orbit etc. - the general 
solution — it inputs into - null space count section 3. the general solution — the 
- null-space count section 3 calculates the general solution of a joint rate 
which moves on the orbit to which the link which specified the orbit was given, 
and the space (null space) to which a joint rate can change without affecting 
the orbit of the link, and supply the count result of the general solution of a 
joint rate to the target joint rate count section 4, and it supplies the count 
result of null space to the optimization count section 5. 
[0036] The fixed link select data 12 is also inputted into the target joint rate 
count section 4. Furthermore, the location data (fixed position data 8) of the 



link which fixes a location are inputted from the existing movement data etc. 
using the link location (13) in the existing movement data etc. (13). 
Furthermore, the Seki turning point label data 9 which are the desired value of 
each joint are inputted. As this data, the joint value (13) in the existing 
movement data may be used. Furthermore, the movable range of each joint is 
inputted. From the current location and current joint angle of a location fixed 
link, the target joint rate count section 4 which received the above-mentioned 
data calculates an error with an ideal condition, calculates the target joint rate 
which feeds it back, and inputs the result into the optimization count section 5. 
[0037] the optimization count section 5 which received the count result of said 
target joint rate — the general solution in the null space calculated in - null 
space count section 3, the optimal joint rate possible nearest to the target joint 
rate calculated in the target joint rate count section 4 is calculated, and the 
result is supplied to the integral section 6. 

[0038] The integral section 6 integrates with the obtained joint rate, and 
obtains the data of a joint value. It outputs for the preservation to the external 
file 16, or a graphics display on Screen 17 by using the movement data 
containing the time series data of a joint value, and the time series data of a 
link location as output data. 

[0039] The procedure of actual movement generation is as follows. All links (a, 
b, c) to fix the location in space to are chosen. The link (p) which wants to 
specify an orbit as real time is chosen. If required, the joint movable range will 
be set up suitably. The orbit given to the link p which specifies an orbit is 
inputted with a suitable interface, reproducing it, when movement is already 
given. In addition, to the links a, b, and c to fix the location in space to at this 
time, the location of each time of day in the original movement is given as a 
fixed position, and the joint value of each time of day in the original movement 
is given as a Seki turning point label value. 

[0040] Movement generated at this time shall satisfy two or more constraint of 
all — making a joint angle into the value near desired value if possible (it 
containing, also when desired value carries out time amount change), and a 
joint does not deviate from the movable range — or the part which fixes to the 
location where the link of arbitration some was directed in space (the case 



where the specified location carries out time amount change is included). 
However, a constraint is not necessarily restricted to these three kinds, and if 
it is a constraint which can be expressed in the same format, it is incorporable 
without limit. 

[0041] Next, the more concrete operation gestalt of this invention is explained. 
In the movement generated software using this invention, if a user chooses 
the link which gives an orbit suitably, and the link which fixes a location and 
gives an orbit and a location, respectively, the optimal movement in 
consideration of a target joint value or the joint movable range will be 
calculated every moment. Drawing 3 is drawing explaining the example of the 
interface in such movement generated software. Such an interface is called a 
pin / DORAKKU interface. Fixing some all over space among the links shown 
by a, b, c, and p, (pinning) the fundamental function of this interface moves 
the link of an exception as the user directed (drag). 

[0042] A target [ generation / by above-mentioned pin/drag / of operation ] is 
generation of the following actuation. 

(1) Move on the orbit as which the DORAKKU link was specified. 

(2) It is fixed to the location where the pinning link was directed. 

(3) Each joint does not deviate from the movable range. 

(4) If possible, approach the desired value to which each joint value was given. 
As for this, it is clearly unreal to solve analytically in the reverse kinematics 
count which many constraints joined. Moreover, it is also enough considered 
for conflict between each constraint that a strict solution does not exist. For 
example, if a link is dragged out of the movable range decided in the location 
by which pinning was carried out, the solution which is satisfied with 
coincidence of conditions (1) and (2) does not exist. 

[0043] In 1 operation gestalt of the approach by this invention, the numerical 
solution using a Jacobian is first applied in reverse kinematics question cost. 
Since it furthermore corresponds to conflict between constraints, four 
constraints are divided into two steps of priority, and are considered. The 
solution which satisfies other three constraints as much as possible in the null 
space which gives the priority of a high order to the constraint (1) about a drag 
link between two constraints mentioned above, and does not affect (1) is 



looked for. Therefore, when conflict is between a constraint (1) and other 
constraints, priority is given to (1), and others are disregarded. 
[0044] Constraint (2) When conflict is between - (4) (i.e., when looking for an 
optimum solution in the null space of (1) and the matrix which carried out rank 
omission appears), in order to cope with it, The singular point low sensibility 
movement decomposition matrix which does not take out an extremely big 
solution by allowing an error also near the singular point (SR-inverse) (in a 
detail) Nakamura, the paper "singular point [ of a joint form robot arm ] low 
sensibility movement decomposition" Society of Instrument and Control 
Engineers collected works by the flower cluster, 453-459 pages, and 1984 are 
referred to - **** — it uses. The pin, the movable range, and desired value of 
a number of arbitration can be given by this, and since an error is distributed 
according to the weight given beforehand when conflict is among these, 
unnatural actuation is not outputted. Moreover, when conflict is canceled, the 
controller which feeds back the error generated by using SR-inverse is 
incorporated so that it may return to the posture in which a constraint is 
satisfied. 

[0045] The Jacobian of the location of the link i about the joint value of a tree 
structure link system is defined as follows. 
[Equation 1] 

[IF 



The vector with which ri put the location of Link i in order and theta put the 
joint value of a tree structure link system in order here, and Ji are the 
Jacobians of the location of the link i about theta. Please refer to the paper 
"count (Efficient Computation of the Jacobian for Robot Manipulators)" 
international JANARUOBU robotics research with the efficient Jacobian about 
a robot manipulator by D.E. Orrin and W.W. Schrader, vol.3, No.4, 66-75 
pages, and 1987 about the approach of calculating this Jacobian efficiently, 
for example. The relation between the rate of Link i and a joint rate is 
expressed as follows using a Jacobian. 
[Equation 2] 



Although a number is numbered and invited to each link of tree structure link 
systems, such as human being, an animal, and a robot, the link which 
becomes the criteria is called root link. While the root link is not being fixed to 
inertial system, the advancing-side-by-side rate and angular velocity are also 
[External Character 1], 

Pi 

It is alike and is contained. It is [Equation 3] if Ji is square regular. 

I B' I 

A joint rate can be found from the rate of Link i as be alike. However, since 
tree structure link systems, such as human being, an animal, and a robot, 
usually have 30 or more degrees of freedom, Ji has not a square but 
redundancy. At this time, the general solution of a formula (2) is a false 
inverse matrix [outside 2]. 

a 

Rice cake ****, [Equation 4] 

la- l 

It is expressed. E is a unit matrix and y is the vector of arbitration here. The 
2nd term of the formula (4) right-hand side can express the null space by 
redundancy, and can look for the solution with which it is satisfied of others 
and a constraint, without changing the rate of Link i using this. 
[0046] Below, the count for generation of the actuation in 1 operation gestalt 
of the approach by this invention is explained. First, the general solution of the 
joint rate which can be moved to the location which had the drag link specified 
is calculated. The orbital location where the drag link was directed [outside 3] 

N~ i 

It is alike and the general solution of [outside 1] which is followed is calculated. 
If it is the current position of the link which has rP dragged, the target rate in 



consideration of feedback will be calculated by the degree type. 
[Equation 5] 

la" 1 

KP is the gain matrix of a positive-definite value here. 
[External Character 4] 

The relation of <BR> uses Jacobian JP about the joint value of the link 
location dragged, and is [Equation 6], 

It is expressed. Target rate [outside 5] 

The general solution of the joint rate [several 1] to realize is calculated by the 
degree type. 
[Equation 7] 

la" I 

Feedback control is performed for compensating an integral error here. 
Moreover, if a false inverse matrix with weight is used instead of the usual 
false inverse matrix, "hardness, i.e., the ease of moving," and the difficulty of 
moving of each joint can be adjusted. 

[0047] The count about other constraint is explained. About a formula (7), it is 
[Equation 8]. 

la" I 

It rewrites. It is here and is [External Character 6]. 

iFT 1 



It comes out. Suppose that the link by which pinning was carried out is 
expressed with NF individual, and those locations are expressed with rFi (i= 
1, NF). Moreover, the joint to which the objective function value was given 



presupposes that those with ND individual and those target joint values are 
expressed with thetaD. The joint of NL individual exceeds the movable range 
and suppose that those joint values are expressed with thetaL NL is working 
- it may change always. Vector paux is defined as follows using these. 
[Equation 9] 



a 



[External Character 7] 

The following relation between joint rates [outside 1] is like a formula (2). 
[Equation 10] 

■pi- =i 

About count of Jaux, it mentions later. The arbitration vector y is calculated as 
follows. It is the target rate [outside 8] of paux first. 



EL 



It calculates by the approach of mentioning later. It is [Equation 11] when a 
formula (8) is substituted for a formula (10). 



********** 



. It is here and is [External Character 9]. 



It comes out. 
[External Character 10] 



It deforms into the formula of the easy form below 
[Equation 12] 



Since S is not necessarily a full rank, SR-inverse is used in order to solve this 
equation. If SR-inverse of S is expressed as S*. y is calculable like a degree 
type. 

[Equation 13] 

Joint rate [outside 1] ****** is substituted for a formula (8) and it is obtained, 
and if it integrates with it further, the joint angle data of each frame will be 
obtained. 

[0048] The count of Jaux mentioned above is explained. When the Jacobian 
about the joint value of rFi is expressed with JFi (i= 1 , NF), it is [Equation 
14] to all the links by which pinning was carried out. 



********** 



About the joint to which the target joint value was given, it is the rate 
[outside 11]. 



-R- 



****** 



is expressed like a degree type. 
[Equation 15] 

I R- =l 

JD is the matrix from which a ** (i, j) element is set to 0 when other, 1 and 
here, when the i-th joint of thetaD is equivalent to the j-th joint of theta. 
Similarly, it is [External Character 12]. 



4^- 



The relation with ****** is [Equation 16]. 
Inn- I 



It is expressed. JL is the matrix from which a ** (i, j) element is set to 0 when 
other, 1 and here, when the i-th joint of thetaL is equivalent to the j-th joint of 
theta. Summarizing the above matrix, Jaux becomes the following forms. 



Equation 17] 
__ _ 



About the part corresponding to the spherical-surface joint of JFi, JP, and JL, 
it mentions later. 

[0049] [External Character 13] mentioned above 

****** is explained. The target rate of the link by which pinning was carried out 
[outside 14] 

B« 

It is calculated by the **** type. 
[Equation 18] 

l a- I 

rFiref is the location of a pin and KFi is the gain matrix of a positive-definite 
value here. The target rate of the joint to which the target joint value was 
given [outside 15] **, [jlj]* 

[Equation 19] 

It is calculated. The vector with which thetaDref compared the target joint 
value here, and KD are the gain matrices of a positive-definite value. The 
target rate of the joint beyond the movable range is calculated as follows. 
Equation 20] 

ir 



thetaLimax and thetaLimin express the maximum and the minimum value of a 



joint angle, respectively, and KLi is forward gain here. A formula (19) and (20) 
are applicable only to 1 degree-of-freedom joint. The handling of a spherical- 
surface joint is described below. 

[0050] First, the target joint value of a spherical-surface joint is explained. The 
rotation matrix and angular velocity of 3x3 expressed with parent link system 
of coordinates, respectively define the joint value Ri of a spherical-surface 
joint, and joint rate omegai. If target joint value RDi**R 3x3 is given to a 
spherical-surface joint, a target rate will be the following, and will be made and 
obtained. About the error vector ei between the current joint value Ri and the 
target joint value RDi, it is [Equation 21] first. 
W 



It calculates "Be alike." deltaRi (m, n) shows the ** (m, n) element of deltaRi 
here. Next, it is [Equation 22] about target angular-velocity omegaDid. 

It calculates "Be alike." Here, KDi is the gain matrix of a positive-definite value. 
To a spherical-surface joint, it is used instead of a formula (21)-type (23) 
being a formula (19). The Jacobian which becomes a part of JFi, JD, and JL 
corresponding to a spherical-surface joint consists of three trains, and each 
train corresponds to surrounding rotation of x, and y and z. Each train is 
calculable like the rotation joint centering on a corresponding direction, 
respectively. 

[0051] Next, the joint movable range of a spherical-surface joint is explained. 
Since a spherical-surface joint has three degrees of freedom, the movable 
range is expressed as a field in three-dimension space. It is important for 
improvement in calculation speed for various approaches to be shown in the 
expression of a posture and to choose a suitable approach. For example, if 
the Eulerian angle often used is used for a posture expression, the movable 
range will become a very complicated configuration for nonlinearity, and 
calculation speed will fall as a result. Here, how to be easier to understand the 



movable range of a spherical-surface joint intuitively, and express it is 
described. As shown in drawing 4 , the spherical-surface joint movable range 
is expressed using a total of three parameters which doubled two parameters 
showing the direction of a link, and one parameter showing a twist angle. The 
direction of a link in case Ri is a unit matrix is expressed with a unit vector diO. 
The direction di of an actual link is acquired by rotating diO like drawing 5 
around the vector ai included at a flat surface perpendicular to diO. The die 
length of ai is set to sin (gammai/2) when an angle of rotation is set with 
gammai. The twist angle alpha is defined as an angle of rotation required in 
order to make in agreement with Ri the frame with which Ri is obtained from 
the condition of a unit matrix by rotating around ai. As mentioned above, all 
the postures that a spherical-surface joint can take will be included in the 
shape of [ of the radius 1 centering on diO, and height 2pi ] a cylinder. In this 
operation gestalt, it is referred to as di0=(100) T to all spherical-surface joints, 
therefore ai is contained in yz side. That is, it is expressed ai=(Oayaz) T. 
Therefore, the movable range becomes the form of the shape of a column 
which has a shaft parallel to alpha shaft in space like drawing 6 (ay, az, alpha), 
ay, az, and alpha are calculated as follows. From di0=(100) T, it is [Equation 

23]. 
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It comes out. Therefore, ay and az are [Equation 24]. 



It asks. Since system of coordinates after performing rotation of the 
circumference of ai, and the x axis of Ri are in agreement, the twist angle 
alpha is searched for from the angle which those y-axes and z-axes make. 
Although a formula (25) and a formula (26) serve as the singular point at the 
time of gammai=**pi, since it is usually out of the movable range, it does not 
become a problem in practice. 



[0052] If three parameters corresponding to a certain posture can be found, it 
will judge whether there is it within movable limits next. Movable range like 
drawing 6 is efficiently calculable by expressing as a pillar-shaped polyhedron. 
In this operation gestalt, it is a triangular set and the movable range within an 
ay-az flat surface is expressed with the upper limit and lower limit of the twist 
angle alpha, respectively. [ in / for the movable range / each triangular top- 
most vertices ] The judgment of movable range inside and outside is 
performed as follows to such a configuration, first, movable, if look for the 
triangle in which (ay, azO) are contained and it is not found — it is out of range. 
When found, it investigates whether it is in a bound further (ay, az, alpha). If a 
thing out of range movable is understood, the target joint rate [outside 7] for 
returning it within movable limits will be calculated. Therefore, the criteria 
posture Rsi is beforehand given to each spherical-surface joint, and target 
angular-velocity omegaLi for going to Rsi is calculated. This is performed, 
when Rsi is substituted to RDi of a formula (22) and it substitutes omegaLi to 
omegaDi of a formula (23), respectively. 

[0053] With the operation gestalt explained so far, it was assumed that the 
location or target joint value of a pin did not carry out time amount change. 
However, it is easy to extend so that those time amount change may be 
included so that it may explain below. By this, the actuation obtained with 
other means, such as motion capture, can be edited on real time, and new 
actuation can be generated. The thing which is the need at an escape is 
following two. 

- The location rFiref, rate [outside 16] of the pin in reference movement 

S3 

It asks by **** kinematics count and a degree type is used instead of a 
formula (18). 
[Equation 25] 

- A target joint value and a target joint rate [outside 17] 

S3 



It carries out, the joint value and joint rate in reference movement are used, 
and a degree type is used instead of a formula (19). 
[Equation 26] 

B~ ] 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing an example of the human figure skating 
which generates data of operation with the data generation method of 
operation by this invention. 

[Drawing 2] It is the flow chart of the program which realizes the data 
generation method of operation by this invention. 

[Drawing 3] It is drawing explaining signs that the data generation method of 
operation by this invention is applied to the human figure skating. 
[Drawing 4] It is drawing showing the joint movable range of a spherical- 
surface joint. 

[Drawing 5] It is drawing showing the link parameter of a spherical-surface 
joint in graph. 

[Drawing 6] (ay, az, alpha) It is drawing showing the movable range of the 
solid sphere joint projected on space. 
[Description of Notations] 
1, 14, 15 External interface 

2 Orbital Data 

3 General Solution - Null Space Count Section 

4 Target Joint Rate Count Section 

5 Optimization Count Section 

6 Integral Section 



7 Movement Data 

8 Fixed Position Data 

9 Joint Location Data 

10 Movable Range Data 

1 1 The Orbital Appointed Link Select Data 

12 Fixed Link Select Data 

13 The Existing Movement Data 

16 File 

17 Screen Display 



